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Abstract. In symplectic geometry a question of great importance is whether a 
(Lagrangian) submanifold is displaceable, that is, if it can be made disjoint from 



o 

itself by the means of a Hamiltonian isotopy. In these notes we analyze the coadjoint 
orbits of SU (n) and their Lagrangian submanifolds that are fibers of the Gelfand- 
Tsetlin map. We use the coadjoint action to displace a large collection of these 
i— i fibers. Then we concentrate on the case n = 3 and apply McDuff 's method of probes 

o 

to show that "most" of the generic Gelfand-Tsetlin fibers are displaceable. "Most" 

i^h means "all but one" in the non-monotone case, and means "all but a 1-parameter 

family" in the monotone case. In the case of non-monotone manifold of full flags we 

present explicitly an unique non-displaceable Lagrangian fiber (S 1 ) 3 . This fiber was 

J> already proved to be non-displaceable in [NNU10] . Our contribution is in displacing 

O 

other fibers and thus proving the uniqueness. 

d 

(N 



1. Introduction 

In symplectic geometry one can observe a rigidity of intersections: certain submani- 
folds are forced to intersect each other in more points than an argument from algebraic 
or differential topology would predict. This motivates the following question: given a 
(usually Lagrangian) submanifold L of a symplectic manifold (M, u) does there exist 
a Hamiltonian diffeomorphism <p e Ham (M, u) such that 4>(L) D L = 0. If such 
exists, we call L displaceable. Otherwise L is called non-displaceable. 
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Hamiltonian torus actions have interesting applications in answering this question. 
Generic fibers of momentum map are coistoropic submanifolds. In the case of toric ac- 
tions (i.e. when dimension of torus acting is equal to half of the dimension of manifold) 
generic fibers are Lagrangians. 

An important class of examples of symplectic manifolds is given by coadjoint orbits of 
Lie groups. A Lie group G acts on g*, the dual of its Lie algebra, through the coadjoint 
action. Each orbit M of the coadjoint action is naturally equipped with the Kostant- 
Kirillov symplectic form. For example, when G = SU(n) the group of (complex) 
unitary matrices, a coadjoint orbit can be identified with the set of traceless Hermitian 
matrices with a fixed set of eigenvalues. It can be also viewed as a manifold of flags 
(full of partial, depending on the orbit) in C n with appropriately scaled symplectic 
form. The coadjoint action of the maximal torus of SU(n) is Hamiltonian, but not 
toric (except n = 2 case). This action can be extended to a "Gelfand-Tsetlin" action 
which is toric, but is defined only on an open dense subset of the orbit. Generic fibers 
of the Gelfand-Tsetlin momentum map are Lagrangians and one may ask about their 
displaceability. Nishinou, Nohara and Ueda proved in |NNU10j that at least one of 
these fibers in non-displaceable. This paper is a step towards answering the question of 
uniqueness of such fiber. We explicitly displace a large collection of fibers of momentum 
maps (for standard action and for Gelfand-Tsetlin action). In particular we prove that 
for non-monotone orbits of SU(3) there is unique non-displaceable Gelfand-Tsetlin 
fiber. 

Theorem 1.1. In the case of non-monotone regular SU(3) coadjoint orbit through 
diag (a, b, —a — b) G su(3)* = the Gelfand-Tsetlin fiber above the point 

(|, -|,0) zfb<0 
(^,-^,0) tfb>0 
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is the unique fiber of the Gelfand-Tsetlin map that is non-displaceable. 

Organization. Section [2] provides background about standard action and the 
Gelfand-Tsetlin action. 

Acknowledgments. The author is very grateful to Yael Karshon for suggesting this 
problem and helpful conversations during my work on this project. The author also 
would like to thank Leonid Polterovich and Strom Borman for useful discussions. 

2. Preliminaries 

2.1. Standard action. Consider the Lie group G = SU(n). We identify the dual of 
its Lie algebra, su(n)*, with the vector space of n x n traceless Hermitian matrices. 
Choose the maximal torus of SU(n) to be T st = {diag(e rfl , . . . , e ^-i ; e - i (*i+--+*"-i))} ) 
and the positive Weyl chamber to consist of diagonal Hermitian matrices with non- 
increasing diagonal entries. Let A = diag(Ai, . . . , A n ), Ai > ... > A ra , = 0, 
be a point in the interior of positive Weyl chamber. The coadjoint action of SU(n) 
on su(n)* is by conjugation. Let M be the orbit of coadjoint action of SU(n) on 
A. It is a symplectic manifold with Kostant-Kirillov symplectic form, of dimension 
\n{n — 1). The coadjoint action is Hamiltonian with momentum map the inclusion 
$ : M su*(n). The action of T st (subaction of coadjoint action) is also Hamiltonian 
with momentum map /i : M — )• t* 4 = E" _1 = {(a?i, . . . , x n ) G t* st = W n \ £ x t = 0} C t* st 
sending a matrix in M to its diagonal entries: //([a^]) = (a 11; . . . , a„ n ). Denote by 
Q = Q\ C M n_1 the polytope that is the image of momentum map \i. Left picture on 
figure [T] presents this polytope with additional data, so called "x-ray" [j] for the case 
n = 3. 

1 The x-ray of (M, u, cj)) is the collection of convex polytopes 4>(X) over all connected components 
X of M K for some subtorus K of T (for more details see |Tol98| ). 
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Figure 1. The x-ray for the standard T st action and the image of the 
Gelfand-Tsetlin functions for a regular SU (3) orbit 



2.2. The Gelfand-Tsetlin system. In this subsection we recall the Gelfand-Tsetlin 
(sometimes spelled Gelfand-Cetlin, or Gelfand-Zetlin) system of action coordinates, 
which originally appeared in |GS83aj . It is related to the classical Gelfand-Tsetlin 
polytope introduced in |GT50] . There are many references describing this system, for 
example |Pabl2] . |GS83aj . |KogOO| . Here we concentrate only on the SU(3) case. 

For any matrix A e M, and any k — 1, . . . , n — 1 let A^A) > . . . > X^\A) denote 
the eigenvalues of k x k top left minor of A. This defines \n{n — 1) continuous, not 
everywhere smooth functions from M to R. The eigenvalues depend smoothly on ma- 
trix entries but ordering them may violate the smoothness at points where eigenvalues 
coincide. The system A = {\f ] ; 1 < k <n - 1, 1 < j < k}: M -> Rs^*- 1 ) is called 
the Gelfand-Tsetlin system of action coordinates. Let 



U :={Ae M; V fc A^V) > • • • > K ( A )} C M. 



The Gelfand-Tsetlin functions are smooth on U and there they integrate to an action 
of a torus T GT = (S 1 )^™" 1 ) called the Gelfand-Tsetlin action ( jGS83a| . [Pabl2] ). 
This action is Hamiltonian with momentum map the restriction of A to U . The image 
A(M) is called the Gelfand-Tsetlin polytope (see right picture in Figure [TJ. We 
denote it by V = V\. 
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The standard action of the maximal torus is a subaction of the Gelfand-Tsetlin 
action. Therefore there is a projection map pr : t* GT = IR5 n ( ra_1 ) — >■ MJ 1 = t* t given by 

P r({A«>}) = (A' 1 '. (Af» + A« 2 »-A<"),..., ^A'- 1 ' -£A<- 2 >,1> -^r"), 

which maps T 3 to Q. Note that fi = pr o A. 

2.3. The Gelfand-Tsetlin polytope. The classical mini max principle (see for ex- 
ample Chapter 1.4 in |CH62| ) implies that 

These inequalities, taken over I — 1, ... ,n — 1, j — 1, ... ,1, (with the convention that 
\ { ™\A) = Xj), cut out a polytope in R(V2)»»(»-i). i n f ac t this is exactly the Gelfand- 
Tsetlin polytope V = A(M) ( |GS83aj . [Pabl2] ) . 

3. Displacing through Hamiltonian isotopies 

In this section we prove that certain subsets of the coadjoint orbit are displaceable 
by means of Hamiltonian isotopies. 

3.1. Displacing fibers of the standard action. We continue to denote by M a 
regular SU(n) coadjoint orbit through (Ai,...,A n ), Aj = 0. Recall from Section 



2.1 that the standard action of the maximal torus of SU{n) is Hamiltonian, with 
momentum map \i. 

The fibers of \l above interior points of Q are coistoropic submanifolds of dimension 
n(n — 2), (so not Lagrangian except if n = 2). 



Proposition 3.1. The fiber of fi above interior point of Q, x = (xi, . . . ,x n ) ^ 
(0, . . . , 0), is displaceable. 
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Proof. For any even permutation a G A n C S n its matrix, P a is in SU(n). Therefore 
conjugating with P a is a Hamiltonian isotopy (SU(n) is connected). Note that the 
diagonal entries change in the following way under this conjugation: 

n(P a AP ) = a(ji(A)). 

Thus ^(PcrAPcr) = /Jj(A) for all a G A n if and only if an = ... = a nn . Therefore 
for any x = (x\, . . . , x n ) 7^ (0, . . . , 0), there exists a a G A n such that a Hamiltonian 
isotopy P a displaces the fiber y u~ 1 (a;). □ 

3.2. Displacing fibers of the Gelfand-Tsetlin system in general case. In this 
subsection we will analyze the problem of displacing generic fibers of the Gelfand- 
Tsetlin system. The fibers above interiors points of V are Lagrangian tori (5' 1 )( 1 / 2 ) n (™- 1 ). 
The fibers above boundary points which are contained in U are isotropic and of dimen- 
sion smaller then | dim M, therefore they are displaceable. The fibers above boundary 
points not contained in U might be of larger dimension. For example, in n = 3 case the 
fiber above the unique not smooth point of V (unique 4-valent vertex) is a Lagrangian 
sphere S 3 ( |Ima09j ). 

Let W = pr _1 ((0, . . . , 0)) where pr is the projection pr : i* GT — > t* st satisfying pr o A = 
\i defined in Section |2.2| 

Proposition 3.2. The Gelfand-Tsetlin fiber above any point x = (x%,...,x n ) G P\W 
is displaceable. 

Proof. Note that this fiber, A _1 (x), is contained in the fiber n~ 1 (pr(x)). Our assump- 
tions guarantee that pr(x) 7^ (0, . . . , 0) therefore conjugation with appropriate matrix 



P a displaces the whole set \i 1 (pr(x)) off itself (see Proposition 3.1). Thus its subset, 
A _1 (x), is displaceable as well. □ 
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3.3. Displacing fibers of the Gelfand-Tsetlin system in the case n = 3. From 
now on we concentrate on the case n — 3. First we describe explicitly the Gelfand- 
Tsetlin polytope for £77(3) coadjoint orbit through a point diag(a, b, —a — b), a > b. 
The Gelfand-Tsetlin polytope V (presented on the Figure [2j, consists of points x = 
(xi,x 2 ,x 3 ) G IR 3 = i* GT satisfying the following inequalities ( |GS83bj . |Pabl2j ) 

a > x\ > b, 

b > x 2 > —a — b, 
xi > x 3 > x 2 . 

Denote the facets of V: 

facet primitive inward normal 



Ft : 


(x, ei) = a 


(-1,0,0) 


F 2 : 


(x, -ei) = b 


(1,0,0) 


F 3 : 


(x,e 2 ) = b 


(0,-1,0) 


F 4 : 


(x, -e 2 ) = a + b 


(0,1,0) 


F 5 : 


(x,e 3 - ei) = 


(1,0,-1) 


F G : 


(x,e 2 - e 3 ) = 


(0,-1,1) 



To displace more Gelfand-Tsetlin fibers we use McDuff 's method of probes. Recall 
the necessary definitions and lemmas. 

Definition 3.3. |McDll] Let to be a point of some facet F of a rational polytope A 
and a G Z n be integrally transverse to F. The probe PF,a{w) = p a {w) with the 
direction a G Z n and initial point w G F is the half open line segment consisting of w 
together with the points in intA that lie on the ray from w in the direction of a. 
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(a, b, a) 



(a. — al— b, a) 



(a, b, b) 



(b,-a-b,b) 



(b, —a — b, —a — b) 



(a, —a — b, —a — 6) 



Figure 2. The Gelfand-Tsetlin polytope for regular 577(3) orbit 
through (a, b, —a — 6). 

Lemma 3.4. |McDlH Lemma 2.4] Lei A be a smooth moment polytope. Suppose that 
a point u G int A lies on the probe PF,a{w). Then if w lies in the interior of F and u 
is less then halfway along pF, a {w), the fiber L u above u is displaceable. 

The lemma is true for any notion of the length along a line. We will use the affine 
distance. 

In the above lemma A is a smooth polytope, but this condition is not really necessary. 
The only thing we need is the existence of a Darboux chart on M containing the 
whole preimage of the probe. This is true in our case. The only non-smooth point 
of the Gelfand-Tsetlin polytope V is the vertex (b,b,b). As noted above, the set U = 
hr 1 ^ \ {(b,b,b)}) is equipped with the smooth Gelfand-Tsetlin action. Therefore it 
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is a toric (not compact) manifold and we can apply the above lemma for our polytope 
V. 



is 



Lemma 3.5. The fiber above a point x G int V such that x 3 < b and a > x\ > ^ 
displaceable by a probe from Fi in the direction (—1,0,0). 

Proof. Note that (—1,0,0) is integrally transverse to F\. Take x G int V such that 
£3 < b and a > x\ > Then w = (a,X2,xs) is in the interior of the facet F\ and 
the probe from w in the direction (—1,0,0) is the set {(a — t,x 2 ,x 3 ); t G [0,a — b)}. 
As xi > a 



= ^2^1 ^ ne P°i n t (^1,^2,^3) is displaceable by Lemma 



3.4 



□ 



Due to the symmetry of V we can similarly show: 

Lemma 3.6. The fiber above a point x G int V such that x%>b and —a — b<x 2 <—\ 
is displaceable by a probe from F 4 in the direction (0, 1, 0). 

Note that the fibers above points on the boundary of V, other then the point (b, b, b), 
are isotropic tori of dimension less then 3 = ^dimM, so they are also displaceable. 
The fiber A _1 (6, b, b) is a Lagrangian S 3 ( |Ima 09j). 



Therefore from Proposition 3.2 and Lemmas 3.5 3.6 we deduce: 



Corollary 3.7. The only Gelfand-Tsetlin fibers that can possibly be non- displaceable 
are the fibers above points (x\, — X\,0) G V with 

b< Xl <^ ifb>0 

0<X!<1 ifb = 

0<£i<| ifb<0 
Proof. According to the above observation only fibers above interior points or above 

is 



6, b) could be non-displaceable. Note that the set W in Proposition 3.2 



W = pr _1 (0) = {(xi, -xx, 0) G V}. 
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If b > then applying Lemma 3.5 we displace fibers above points (xi,— #i,0) with 



a > x\ > If b < 0, we apply Lemma 3.6 and displace fibers above points 



(xi, —Xi, 0) with a + b > X\ > |. □ 

Remark 3.8. The Lagrangian sphere A -1 (b, b, b) could be non-displaceable only in the 
case b = (the case of monotone orbit). 

3.4. The monotone case. A symplectic manifold (M, u) is called spherically mono- 
tone if there exists k > such that for any class X in the image of Hurewicz homo- 
morphism ^(M) — > H2(M) have that 

c x {TM)[X] = kco(X). 

Above C\(TM) denotes the first Chern class. 

In this subsection we consider the case of b = 0, that is M is the SU(3) orbit through 
A = (a, 0, —a) for some a > 0. Then M is spherically monotone. Recall the theorem 
Entov and Polterovich. 

Theorem 3.9. |EP06l Theorem 2.1] Let M be a closed connected rational and spheri- 
cally monotone symplectic manifold. Any finite- dimensional Poisson commutative sub- 
space ofC°°(M) has at least one non-displaceable fiber. 

(In [EP06] it is assumed that M is strongly semi-positive. Spherically monotone 
manifolds are a special class of strongly semi-positive.) 

We will consider unnormalized Gelfand-Tsetlin functions. For any matrix A = [ay] G 
M let b^(A) = an, and let bi(A), b2(A) be the coefficients of the characteristic polyno- 
mial of the 2x2 top left minor of A, i.e. the characteristic polynomial is t 2 + b\t + b 2 . 
These three functions, smooth on M, are sometimes called unnormalized Gelfand- 
Tsetlin functions. They have the same level sets as the Gelfand-Tsetlin functions 
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(d, 0,2, 03). Note that functions b\ and 62 are U(2) invariant, so they Poisson commute. 
Proposition 3.2 in [GS83a] gives that all three functions: 61, 62 and 63 Poisson commute. 
The subspace of c7°°(M) generated by the functions b±, h 2 and 63 is finite-dimensional 
and Poisson commutative. Now we start the search of this non-displaceable fiber. 

The theorem Entov and Polterovich quoted above proves the existence of non- 
displaceable fiber of the map 62,^3)- Such a fiber is also a fiber of the Gelfand- 
Tsetlin system. This proves the following proposition. 

Proposition 3.10. For the SU(3) orbit through (a, 0, —a), a > there exists at least 
one non-displaceable fiber of the Gelfand-Tsetlin system. That is, there exists at least 
one p G V such that A~ 1 (p) is non-displaceable. 



Corollary 3.7 gives that this non-displaceable fiber must be of the form A 1 (x\, — x\, 0) 



for some < x\ < |. We cannot show that they are non-displaceable, but we can prove 



Proposition 3.11. The fibers above points (x±, — x±,0) G V with < X\ < | are not 

displaceable by probes. 



Proof. Let 



N '■— {{ x ii —xii 0) G V; 0<X! < |}. 



First notice that these fibers are not displaceable by probes from facets Fx, F 4 because 
the distance from any of these facets to iV along any probe is at least half of the length 
of the probe. 

The vectors integrally transverse to F2 are of the form (1, k, I) for k, I G Z. The 
line {(xi, — xi, 0) — t(l,k, /); t G 1} intersects interior of the facet F 2 (at a point 
(0, — Xi(k + 1), — Ixij) if and only if 

xi > and 0</<A; + l<— . 

Xi 
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The affine distance from (0,—xi(k + l),—lxi) to (x± : — x±,0) in the direction /) 
is X\. Therefore the probe from (0, — X\{k + 1),— Ixi) in the direction of (l,k,l) can 
be used to displace the fiber above (x±, —x±, 0) if and only if the length of the probe is 
greater then 2x±, that is, if 

(0, -xi(k + 1), -lx x ) + 2xi(l, k,l) = (2xi, (A; - G in* P. 

In particular this means that 2 > I and Z > k — 1 > 0. There are no integers k, I 
satisfying these conditions, therefore the fibers above points in iV cannot be displaced 
by probes from the facet F 2 . Similarly one can show that they also cannot be displaced 
by probes from the facet F 3 . 

The vectors integrally transverse to the facet F 5 are of the form (1, k, 0) or (0, k,—l), 
k G Z, but only the second family can give probes intersecting N. The line {(x 1: —x 1: 0) — 
t(0, k, —1); f 6 1} intersects the hyperplane {ei = 63} at a point (xi, —X\ — kxi,Xi). 
This intersection point is in the interior of the facet F 5 if and only if 

x± > 0, > —xi — kxi > —a, and x 1 > —x\ — kxi, 

that is, if —1 < k < — 1 + The distance from (xi,—Xi — kxi,Xi) to (x 1 , —x 1 ,0) 
in the direction (0, k, — 1) is x±. Therefore the probe from (x±,—Xi — kx 1 ,Xi) in the 
direction (0, k, —1) can be used to displace the fiber above (x±, —xi,0) if and only if 

(xi, —xi, 0) + 2xi(0, k, —1) = (xi, kxi — x±, —x±) G intV. 

In particular this means that k < 0. There are no integers k satisfying k < together 
with the condition — 1 < k from above. Therefore the fibers above points in iV cannot 
be displaced by probes from the facet F 5 . Similar argument proves that they cannot 
be displaced by probes from the facet F 6 . □ 
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Patient reader can check that these fibers also cannot be displaced by "extended 
probes" (see [ABMJ for definition). 



3.5. Non-monotone case. Proof of Theorem Using Floer theory, without 



assuming monotonicity, Nishinou, Nohara and Ueda proved in |NNU10j the following 
theorem. 

Theorem 3.12. jNNUlOl Theorem 12.1] For any A G su(n)* let O x stand for the 
SU(n) coadjoint orbit through A. There exists u G lnth(0\) in the interior of the 
Gelfand-Tsetlin polytope for 0\ such that the fiber A" l (u) is non-displaceable. 

Let M be a regular SU (3) coadjoint orbit that is not monotone, that is an orbit 
through A = (a > b > —a — b) for some a, b with 6^0. The above theorem proves 
the existence of non-displaceable Gelfand-Tsetlin fiber. Moreover, computations done 
in Examples in Section 11 of |NNU10] (finding a critical point of the potential funci- 
ton), imply that the fiber above (§,-§, 0) if b < 0, or (^,-^,0) if b > 0, is 



non-displaceable. Below, while proving Theorem |1.1[ we recover this result, not via 
potential functions methods of |NNU10j . but by displacing other fibers using probes. 
The advantage of our method is that it also proves uniqueness and displaces the bound- 
ary fibers (like the Lagrangian sphere A _1 (6, b, b)). 



From Corollary |3.7| we know that the non-displaceable fiber must be of the form 
A~ 1 (xx, — Xx, 0) for some (xx,—Xi,0) G intV. The Figure [3] shows slices of Gelfand- 
Tsetlin polytope at 23 = for the cases of b < and b > 0, that is, a polytope in 
1R 2 satisfying max(0, b) < x\ < a and —a — b < X2 < min(0, b). The black bold line 
segment corresponds to the possibly non-displaceable fibers. 

Lemma 3.13. If b < then the fibers above points (21,22,0) with < x\ < a and 
— I < 2 2 < b (shaded region) are displaceable by probes. 
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Figure 3. The slices of the Gelfand-Tsetlin polytope at x% = for b < 
and b > 0. 

Proof. The vector (0,-1,0) is integrally transverse to the facet F3. Take any point 
(x\,X2, 0) satisfying the above conditions. Then a point w = {x\, b, 0) is in the interior 
of F 3 and the probe from w in the direction of (0, — 1, 0) is the set {(xi, b — t, 0); t £ 
[0, a + 26)}. Our assumptions imply that —b < —x 2 < | so x 2 = b — t with t < b + |. 
Therefore the point (xi,x 2 ,0) is displaceable by probe from w. □ 



If b = then the point u; = 0) = (a;, 0,0) is on the boundary of F 3 and the 
probe could not start from w 



Lemma 3.14. If b > then the fibers above points (xi,X2,0) with b < X\ < g ^ and 
—a — b < X2 < (shaded region) are displaceable by probes. 

Proof. The vector (1, 0, 0) is integrally transverse to the facet F 2 . Take any point 
(xi, X2, 0) satisfying the above conditions. Then a point v = (b, x 2 , 0) is in the interior of 
F\ and the probe from v in the direction of (1, 0, 0) is the set {(b+t, x 2 , 0); i 6 [0, a— b)}. 
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Our assumptions imply that X\ = b + t with t < Therefore the point (x\, x 2 , 0) is 
displaceable by probe from v. □ 



If b = then the point v = (0, x 2 , 0) is on the boundary of F±. 



Proof. ( of Theorem 1.1) The above Lemmas with Theorem 3.12 prove Theorem □ 
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